Clemson  University 
College  of  Engineering  and  Science 
Control  and  Robotics  (CRB)  Technical  Report 


Number:  CU/CRB/5/12/04/#l 
Title:  Visual  Servo  Tracking  Control  of  a  Wheeled  Mobile 
Robot  with  a  Monocular  Fixed  Camera 
Authors:  J.  Chen,  W.  E.  Dixon,  D.  M.  Dawson,  and  V.  K. 

Chitrakaran 


Report  Documentation  Page 

Form  Approved 

OMB  No.  0704-0188 

Public  reporting  burden  for  the  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions,  searching  existing  data  sources,  gathering  and 
maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of  information, 
including  suggestions  for  reducing  this  burden,  to  Washington  Headquarters  Services,  Directorate  for  Information  Operations  and  Reports,  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington 

VA  22202-4302.  Respondents  should  be  aware  that  notwithstanding  any  other  provision  of  law,  no  person  shall  be  subject  to  a  penalty  for  failing  to  comply  with  a  collection  of  information  if  it 
does  not  display  a  currently  valid  OMB  control  number. 

1.  REPORT  DATE 

2QQ4  2.  REPORT  TYPE 

3.  DATES  COVERED 

00-00-2004  to  00-00-2004 

4.  TITLE  AND  SUBTITLE 

Visual  Servo  Tracking  Control  of  a  Wheeled  Mobile  Robot  with  a 
Monocular  Fixed  Camera 

5a.  CONTRACT  NUMBER 

5b.  GRANT  NUMBER 

5c.  PROGRAM  ELEMENT  NUMBER 

6.  AUTHOR(S) 

5d.  PROIECT  NUMBER 

5e.  TASK  NUMBER 

5f.  WORK  UNIT  NUMBER 

7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS(ES) 

Clemson  University, Department  of  Electrical  &  Computer 

Engineering, Clemson, SC, 29634-0915 

8.  PERFORMING  ORGANIZATION 

REPORT  NUMBER 

9.  SPONSORING/MONITORING  AGENCY  NAME(S)  AND  ADDRESS(ES) 

10.  SPONSOR/MONITOR'S  ACRONYM(S) 

11.  SPONSOR/MONITOR'S  REPORT 
NUMBER(S) 

12.  DISTRIBUTION/AVAILABILITY  STATEMENT 

Approved  for  public  release;  distribution  unlimited 

13.  SUPPLEMENTARY  NOTES 

The  original  document  contains  color  images. 

14.  ABSTRACT 

15.  SUBIECT  TERMS 

16.  SECURITY  CLASSIFICATION  OF:  17.  LIMITATION  OF 

18.  NUMBER  19a.  NAME  OF 

a.  REPORT  b.  ABSTRACT  c.  THIS  PAGE 

unclassified  unclassified  unclassified 

li 

Standard  Form  298  (Rev.  8-98) 

Prescribed  by  ANSI  Std  Z39-18 


Visual  Servo  Tracking  Control  of  a  Wheeled  Mobile  Robot  with  a 

Monocular  Fixed  Camera* 

J.  Client  W.  E.  Dixon,*  D.  M.  Dawson,*  and  V.  K.  Chitrakaran* 

^Department  of  Electrical  &  Computer  Engineering,  Clemson  University,  Clemson,  SC  29634-0915 
*Eng.  Science  and  Tech.  Div.  -  Robotics,  Oak  Ridge  National  Lab.,  P.O.  Box  2008,  Oak  Ridge,  TN  37831-6305 
E-mail:  jianc@ces.clemson.edu,  dixonwe@ornl.gov,  ddawson@ces.clemson.edu,  cvilas@ces.clemson.edu 


Abstract 

In  this  paper,  a  visual  servo  tracking  controller  for 
a  wheeled  mobile  robot  (WMR)  is  developed  that  uti¬ 
lizes  feedback  from  a  monocular  camera  system  that  is 
mounted  with  a  fixed  position  and  orientation  (i.e. ,  the 
eye-to-hand  problem).  A  prerecorded  image  sequence 
(e.g.,  a  video)  of  four  target  points  is  used  to  define  a 
desired  trajectory  for  the  WMR.  By  comparing  the  tar¬ 
get  points  from  the  prerecorded  sequence  with  the  corre¬ 
sponding  target  points  in  the  live  image,  projective  geo¬ 
metric  relationships  are  exploited  to  construct  a  Euclid¬ 
ean  homography.  The  information  obtained  by  decom¬ 
posing  the  Euclidean  homography  is  used  to  develop  a 
kinematic  controller.  A  Lyapunov-based  analysis  is  used 
to  develop  an  adaptive  update  law  to  actively  compensate 
for  the  lack  of  depth  information  required  for  the  trans¬ 
lation  error  system.  In  contrast  to  previous  WMR  visual 
servo  controllers  using  a  fixed  camera  configuration,  the 
controller  in  this  paper  does  not  require  the  camera  to  be 
mounted  so  that  the  optical  axis  is  perpendicular  to  the 
WMR  plane  of  motion.  An  extension  is  provided  to  il¬ 
lustrate  the  development  of  a  visual  servo  regulation  con¬ 
troller.  Simulation  results  are  provided  to  demonstrate 
the  performance  of  the  tracking  control  design. 

1  Introduction 

Due  to  the  nonholonomic  nature  of  a  wheeled  mobile  ro¬ 
bot  (WMR)  and  the  standard  encoder  hardware  configu¬ 
ration  (e.g.,  optical  encoders  mounted  on  the  actuators), 
the  Euclidean  position  is  difficult,  to  accurately  obtain. 
That  is,  the  linear  velocity  of  the  WMR  must  first  be  nu¬ 
merically  differentiated  from  the  encoder  readings  (i.e.,  by 
the  backwards  difference  algorithm)  and  then  the  non¬ 
linear  kinematic  model  must  be  numerically  integrated 
to  obtain  the  Euclidean  position  (i.e.,  dead  reckoning). 

*This  research  was  supported  in  part  U.S.  DOE  Office  of  Biolog¬ 
ical  and  Environmental  Research  (OBER)  Environmental  Manage¬ 
ment  Sciences  Program  (EMSP)  project  ID  No.  82797  at  ORNL 
for  the  DOE  Office  of  Science  (SC),  a  subcontract  to  ORNL  by  the 
Florida  Department  of  Citrus  through  the  University  of  Florida,  and 
by  U.S.  NSF  Grant  DMI-9457967,  ONR  Grant  N00014-99-1-0589, 
a  DOC  Grant,  and  an  ARO  Automotive  Center  Grant. 


Since  numerical  differentiation/integration  errors  may  ac¬ 
cumulate  over  time,  it  is  well  known  that  navigation  by 
dead  reckoning  is  relatively  inaccurate.  Given  recent  ad¬ 
vances  in  image  extraction/interpretation  technology  and 
advances  in  control  theory,  an  interesting  approach  to 
overcome  this  position  measurement  problem  is  to  utilize 
a  vision  system  for  navigation. 

Motivated  by  the  above  discussion,  it  is  clear  from  a  re¬ 
view  of  literature  that  numerous  researchers  have  investi¬ 
gated  the  use  of  a  vision  system  for  WMR  navigation.  For 
example,  using  Extended  Kalman  Filtering  (EKF)  tech¬ 
niques  on  the  linearized  kinematic  model,  the  authors  of 
[6]  used  feedback  from  a  monocular  omnidirectional  cam¬ 
era  system  to  enable  wall  following,  follow-the-leader,  and 
position  regulation  tasks.  Also  using  EKF  techniques, 
the  authors  of  [13]  recently  proposed  a  monocular  visual 
servo  tracking  controller  for  WMRs  that  relies  on  con¬ 
secutive  image  frames  and  an  object  database.  However, 
a  drawback  of  the  EKF  approaches  developed  in  [6]  and 
[13]  is  the  linearization  requirement.  In  [12],  Hager  et 
al.  used  a  monocular  vision  system  mounted  on  a  pan¬ 
tilt-unit  to  generate  image-Jacobian  and  geometry-based 
controllers  by  using  different  snapshots  of  the  target  and 
an  epipolar  constraint.  As  stated  in  [1],  a  drawback  of 
the  method  developed  in  [12]  is  that  the  system  equations 
become  numerically  ill-conditioned  for  large  pan  angles. 
Burschka  and  Hager  [1]  proposed  a  vision-based  controller 
for  WMRs  with  a  conventional  camera  and  a  pan-tilt  head 
or  a  omnidirectional  camera.  Drawbacks  of  the  result  in 
[1]  include:  1)  the  requirement  for  an  off-line  teaching 
phase  to  estimate  an  object  height  to  allow  for  an  im¬ 
age  Jacobian  to  be  (pseudo)  inverted,  and  2)  the  WMR 
controller  simply  replays  the  prerecorded  linear  and  an¬ 
gular  velocity  signals  obtained  during  the  teaching  phase 
where  the  motion  of  the  WMR  is  restricted  to  circles  and 
straight  lines.  In  [19],  Song  and  Huang  use  spatiotempo- 
ral  apparent  velocities  obtained  from  an  optical  flow  of 
successive  images  to  estimate  the  depth  information  for 
a  monocular  “guide  robot”.  An  optical  flow  estimation 
technique  was  also  developed  in  [14].  However,  typical 
drawbacks  of  optical  flow  techniques  include  the  need  for 
temporal  smoothing  and  excessive  image  processing  to  de¬ 
termine  the  image  flow;  resulting  in  an  intensive  computa- 
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tional  burden  for  real-time  robotics  control.  In  [7],  Dixon 
et  al.  used  feedback  from  an  uncalibrated,  fixed  (ceiling- 
mounted)  camera  to  develop  an  adaptive  tracking  con¬ 
troller  for  a  WMR  that  compensated  for  the  parametric 
uncertainty  in  the  camera  and  the  WMR  dynamics.  Un¬ 
fortunately,  the  result  in  [7]  requires  that  the  camera  be 
mounted  so  that  the  optical  axis  is  perpendicular  with  the 
WMR  plane  of  motion  so  that  the  depth  from  the  camera 
to  the  robot  remains  constant.  An  image-based  visual 
servo  controller  that  exploits  an  object  model  was  pro¬ 
posed  in  [20]  to  solve  the  WMR  tracking  controller  that 
adapted  for  the  constant,  unknown  height  of  an  object 
moving  in  a  plane  through  Lyapunov-based  techniques. 

In  contrast  to  the  previous  image-based  visual  servo 
control  approaches,  novel  homography-based  visual  servo 
control  techniques  (coined  2.5  D  visual  servoing)  have 
been  recently  developed  (e.g.,  [2],  [3],  [15]-[17]).  This 
approach  exploits  a  hybrid  combination  of  reconstructed 
Euclidean  information  and  image-space  information  in 
the  control  design.  The  Euclidean  information  is  recon¬ 
structed  by  decoupling  the  interaction  between  transla¬ 
tion  and  rotation  components  of  a  homography  matrix. 
As  stated  in  [17],  some  advantages  of  this  methodology 
over  previous  image-based  approaches  are  that  an  accu¬ 
rate  Euclidean  model  of  the  environment  (as  in  [20])  is  not 
required  and  potential  singularities  in  the  image-Jacobian 
are  eliminated  (i.e.,  the  image-Jacobian  for  homography- 
based  visual  servo  controllers  is  typically  triangular).  In 

[4] ,  a  homography-based  adaptive  visual  servo  controller 
is  developed  to  enable  a  robot  manipulator  to  track  a  de¬ 
sired  Euclidean-space  trajectory  as  determined  by  a  se¬ 
quence  of  images  for  the  fixed  camera  configuration.  In 
[9],  a  visual  servo  controller  was  developed  to  asymptot¬ 
ically  regulate  the  position/orientation  of  a  WMR  to  a 
constant  Euclidean  position  defined  by  a  reference  image, 
despite  unknown  depth  information  where  the  camera  was 
mounted  on-board  the  WMR.  The  camera  on-board  re¬ 
sult  in  [9]  was  extended  in  [5]  to  address  the  more  general 
tracking  problem  proposed  in  [4]  for  robot  manipulators. 

In  this  paper,  an  adaptive  visual  servo  controller  is  de¬ 
veloped  for  the  off-board,  fixed  camera  configuration  that 
ensures  global  tracking  for  a  WMR  (i.e.,  the  eye-to-hand 
tracking  problem  for  a  WMR).  The  approach  in  this  pa¬ 
per  is  based  on  ideas  from  our  previous  results  in  [4], 

[5] ,  and  [9],  since  the  results  in  this  paper  also  exploit 
homography-based  techniques.  However,  the  error  sys¬ 
tem  development,  control  design,  and  stability  analysis  in 
this  effort  requires  fundamentally  new  control  approaches 
in  comparison  to  our  result  in  [4]  (which  also  examines 
the  fixed  camera  configuration  tracking  problem)  since 
WMRs  are  underactuated  systems  subject  to  nonholo- 
nomic  motion  constraints  (i.e.,  a  typical  feedback  lineariz¬ 
ing  controller  developed  for  holonomic  systems  can  not  be 
used  to  solve  the  problem,  see  [8]  for  further  discussion 
regarding  this  issue).  The  results  in  this  paper  are  also 
in  contrast  to  [5] ,  where  the  camera  is  on-board  a  WMR. 
Specifically,  new  development  is  required  to  address  the 


differences  in  the  open-loop  error  systems  resulting  from 
the  geometric  differences  related  to  the  camera  configura¬ 
tion.  Moreover,  due  to  the  different  camera  configuration 
in  [5]  and  [9],  the  computation  of  the  homography  matrix 
in  the  present  result  is  more  complicated  since  the  image 
features  are  not  confined  to  move  in  a  fixed  plane.  In  con¬ 
trast  to  our  result  in  [7]  (which  does  not  use  homography- 
based  approaches),  the  controller  in  this  paper  does  not 
require  the  camera  to  be  mounted  so  that  the  optical  axis 
is  perpendicular  to  the  WMR  plane  of  motion  (i.e.,  the 
depth  to  the  WMR  is  allowed  to  be  time- varying) .  To 
address  the  fact  that  the  distance  from  the  camera  to  the 
WMR  is  an  unknown  time-varying  signal,  a  Lyapunov- 
based  control  strategy  is  employed  that  provides  a  frame¬ 
work  for  the  construction  of  an  adaptive  update  law  to 
actively  compensate  for  an  unknown  depth-related  scal¬ 
ing  constant.  In  lieu  of  tracking  a  prerecorded  set  of  im¬ 
ages,  the  problem  could  also  be  formulated  in  terms  of 
tracking  the  desired  linear  and  angular  velocities  of  a  ref¬ 
erence  robot.  An  extension  is  provided  to  illustrate  how 
a  visual  servo  regulation  controller  can  also  be  designed 
for  the  fixed  camera  configuration.  Simulation  results  are 
provided  to  demonstrate  the  performance  of  the  tracking 
control  design. 

2  Problem  Formulation 

In  this  paper,  the  planar  motion  of  a  WMR  is  assumed 
to  be  visible  by  a  single  camera  mounted  with  a  fixed 
position  and  orientation1.  An  inertial  reference  frame, 
denoted  by  X,  is  attached  to  the  camera.  The  origin  of 
an  orthogonal  coordinate  system  T  is  coincident  with  the 
center  of  the  WMR  wheel  axis.  As  illustrated  in  Figure 
1,  the  xy-axis  of  T  defines  the  plane  of  motion  where 
the  x-axis  of  T  is  perpendicular  to  the  wheel  axis,  and 
the  y-axis  is  parallel  to  the  wheel  axis.  The  z-axis  of  T  is 
perpendicular  to  the  plane  of  motion  and  is  located  at  the 
center  of  the  wheel  axis.  The  linear  velocity  of  the  WMR 
along  the  x-axis  is  denoted  by  vc(t)  €  R,  and  the  angular 
velocity  ooc(t)  e  M  is  about  the  z-axis  of  T  (see  Figure 
1).  A  desired  trajectory  is  defined  by  a  prerecorded  time- 
varying  trajectory  of  XJ  that  is  assumed  to  be  second- 
order  differentiable  where  vcci{t),  uicd{t)  €  R  denote  the 
desired  linear  and  angular  velocity  of  X,/ ,  respectively.  A 
fixed  orthogonal  coordinate  system,  denoted  by  X*,  rep¬ 
resents  a  fixed  (i.e.,  a  single  snapshot)  reference  position 
and  orientation  of  the  WMR  relative  to  the  fixed  camera. 

3  Model  Development 

To  facilitate  the  subsequent  development,  the  WMR  is 
assumed  to  be  identifiable  by  four  feature  points  denoted 
by  Oi  \/i  =  1,  2,  3,4  that  are  considered  to  be  copla- 

1No  assumptions  are  made  with  regard  to  the  alignment  of  the 
WMR  plane  of  motion  and  the  focal  axis  of  the  camera  as  in  [7]. 
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nar2  and  not  colinear.  It  is  also  assumed  that  a  feature 
point  is  located  at  the  origin  of  the  coordinate  frame  at¬ 
tached  to  the  WMR.  Each  feature  point  on  T,  Td ,  and 
T*  has  a  3D  Euclidean  coordinate  that  can  be  expressed 
in  terms  of  X,  as  fh,(t),  fhdi{t),  fh*  €  R3,  respectively. 
Based  on  the  geometric  relationships  between  the  coordi¬ 
nate  frames  (see  Figure  2),  the  following  expressions3  can 
be  developed  to  relate  the  feature  points  on  T  and  Td  to 
the  feature  points  on  T* 

fhi  =  ( R_+  xhn*T)  fh*  .  , 

fh.di  =  ( Rd  +  xhdn*T )  fh*. 

In  (1),  n*  €  R3  denotes  the  constant  unit  normal  ex¬ 
pressed  in  X  that  is  perpendicular  to  the  WMR  plane  of 
motion,  and  R  ( t ),  Rd{t)  €  SO  (3)  and  %  (t),  Xhd  (t)  €  M3 
are  defined  as  follows 

77  A  I?  f  I?*\T  77  A  7.)  (  t>*\T 

Jtt  —  )  Kd  —  rid  (it  )  /q\ 

Xh  =  xh-  Rx*h  Xhd  =  Xh  -  Rdx*h 


an  arbitrarily  small  positive  constant).  Based  on  (5),  the 
expression  in  (1)  can  be  rewritten  as  follows 


m.j  = 


(R  +  xhn*T )  m* 

H 


mdi  = 


&di 


(Rd.  +  xhdn*T )  m* 

S.  -  y 

Hd 


(6) 

(7) 


where  a*  (f) ,  adi  (t)  €  R  denote  invertible  depth  ratios, 
and  H  ( t ) ,  Hd(t)  €  R3x3  denote  Euclidean  homographies. 


Remark  1  The  subsequent  development  requires  that  the 
constant  rotation  matrix  R*  be  known.  This  is  a  mild  as¬ 
sumption  since  the  constant  rotation  matrix  R*  can  be  ob¬ 
tained  a  priori  using  various  methods  (e.g.,  a  second  cam¬ 
era  or  an  additional  well-calibrated  WMR  pose,  Euclidean 
measurements). 


where  R  (t),  Rd  (t),  R*  €  SORT)  denote  the  rotation  from 
T  to  X,  Td  to  X,  and  T*  to  X,  respectively,  and  Xh  (t) , 
Xhd(t),  x €  R3  denote  the  respective  scaled  translation 
vectors  expressed  in  X  (See  Figure  2).  Also  in  Figure  2, 
Si  €  R3  denotes  the  constant  coordinates  of  the  i  —  th 
target  point,  and  d*  €  R  denotes  the  constant  distance 
from  the  origin  of  X  to  the  WMR  plane  of  motion  along 
the  normal  n*.  From  the  geometry  illustrated  in  Figure 
2,  the  following  relationships  can  be  determined 

d*  =  n*Tfhi  =  n*Tfhdi  (3) 


Each  target  point  on  T ,  T,i ,  and  T*  will  also  have  a 
projected  pixel  coordinate  expressed  in  terms  of  X,  de¬ 
noted  by  U{  (t),  Vi  (f)  €  R  for  T,  udi  (t),  vdi  (t)  €  R  for 
Td ,  and  u*,v*  €  R  for  T* ,  that  are  defined  as  elements  of 
Pi  (t)  (i.e.,  the  actual  time- varying  target  points),  pdi  (t) 
(i.e. ,  the  desired  time- varying  target  point  trajectory), 
and  p*  (i.e.,  the  constant  reference  target  points),  re¬ 
spectively.  To  calculate  the  Euclidean  homography  given 
in  (6)  and  (7)  from  pixel  information,  the  projected  2D 
pixel  coordinates  of  the  target  points  are  related  to  m*  (t) , 
mdi  (' t ),  and  m*  by  the  following  pin-hole  lens  models  [10] 


where 

n*=R[0  0  -l]T  =  i?.d[0  0  -1  ]T.  (4) 


The  relationship  given  by  (1)  provides  a  means  to  quan¬ 
tify  a  translation  and  rotation  error  between  T  and  T* 
and  between  Td  and  T* .  Since  the  Euclidean  position 
of  T ,  Td ,  and  T*  cannot  be  directly  measured,  further 
development  is  required  to  obtain  the  position  and  rota¬ 
tional  error  information  in  terms  of  measureable  image- 
space  coordinates.  To  this  end,  the  normalized  Euclidean 
coordinates  of  the  points  on  T ,  Td ,  and  T*  expressed  in 
terms  of  X  as  m,  (t),  mdi(t),  m*  €  R3,  are  defined  as 
follows 


A 

mi  = 


m 

Zi 


A  ^ Xldi 

nidi  = - 

Zdi 


(5) 


under  the  standard  assumption  that  the  distances  from 
the  origin  of  X  to  the  target  points  along  the  focal  axis 
remains  positive  (i.e.,  Zi  (t),  zdi(t),  z*  >  e  where  e  denotes 

2  It  should  be  noted  that  if  four  coplanar  target  points  are  not 
available  then  the  subsequent  development  can  exploit  the  classic 
eight-points  algorithm  [16]  with  no  four  of  the  eight  target  points 
being  coplanar. 

3  See  [4]  for  details  regarding  the  development  of  the  following 
relationships. 


Pi  =  Ami  Pdi  =  Amdi  p*  =  Am*  (8) 

where  A  €  R3x3  is  a  known,  constant,  and  invertible 
intrinsic  camera  calibration  matrix.  After  substituting 

(8)  into  (6)  and  (7),  the  following  relationships  can  be 
developed 

Pi  =  on  ( AHA _1)  p*  pdi  =  OLdi  ( AHdA _1)  p* 

G  Gd 

where  G  (t)  =  [ gij{t )],  Gd{t)  =  [gdij(t)\  Vi,j  =  1,2,3  e 
R3x3  denote  projective  homographies. 

From  the  first  relationship  in  (9),  a  set  of  12  linearly 
independent  equations  given  by  the  4  target  point  pairs 
(p* ,  pi  (t))  with  3  independent  equations  per  target  point 
pair  can  be  used  to  determine  the  projective  homogra¬ 
phy  up  to  a  scalar  multiple  (i.e.,  the  product  ati(t)G(t) 
can  be  determined).  From  the  definition  of  G(t)  given  in 

(9) ,  various  techniques  can  then  be  used  (e.g.,  see  [11], 
[21])  to  decompose  the  Euclidean  homography,  to  obtain 
cq(t),  G(t),  Hit),  and  the  rotation  signal  R{t).  Like¬ 
wise,  by  using  the  target  point  pairs  ( p*,Pdi  (t)),  the  de¬ 
sired  Euclidean  homography  can  be  decomposed  to  obtain 
adi(t),  Gd{t),  Hd{t),  and  the  desired  rotation  signal  Rd(t). 
The  rotation  matrices  R(t)  and  Rd(t)  can  be  computed 
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from  R(t)  and  Rd(t)  by  using  (2)  and  the  fact  that  R*  is 
assumed  to  be  known.  The  normalized  coordinates  ?n,;  (t) 
and  nidi  (t)  can  be  computed  from  pt  (t)  and  p<ii  (t)  by  us¬ 
ing  (8).  Hence,  R(t),  Rft),  Rd{t),  Rd(t),  m*  (t),  mdi(t), 
and  the  depth  ratios  a,  (t)  and  adi{t)  are  all  known  sig¬ 
nals  that  can  be  used  for  control  synthesis. 

Based  on  the  definitions  for  R  ft),  Rd  ft),  and  R*  pro¬ 
vided  in  the  previous  development,  the  rotation  from  T 
to  T*  and  from  Td  to  T* ,  denoted  by  Rift)  and  Rdi(t), 
are  defined  as  follows 


JD  A  P*T  TD  _ 

III  -  II  It  - 


cos  9  —  sin  6  0 
sin  9  cos  9  0 

0  0  1 


(10) 


follows 

ei  -  Vi  -  Vdi 

e2  =  V-2  -  Vd2  (14) 

e3  =  9  -9d 

where  9{t)  and  9dft)  are  introduced  in  (10)  and  (11),  re¬ 
spectively,  and  the  auxiliary  signals  gift)  =[t]1  ( t ),  p2  (t), 
%]T-  Vd(t)  -[Vdi  (*),  Vd2(t),  VdzY  e  M3  are  defined  as 
follows4 

V  ft)  =  \RTmi  Vd  (*)  =  \Rdfhd i.  (15) 

zi  zi 

From  (3),  (4),  and  (15),  it  can  be  determined  that 


TD  A  P*T  p  _ 

-itdl  —  -tt  ltd  — 


cos  9d 
sin  9d 
0 


-  sin  9d 
cos  9d 
0 


0 

0 

1 


(11) 


where  9 it)  £  M  denotes  the  right-handed  rotation  angle 
about  the  z-axis  that  aligns  T  with  T* ,  and  9d{t)  £  M 
denotes  the  right-handed  rotation  angle  about  the  z-axis 
that  aligns  Td  with  T* .  From  Figure  1  and  the  definitions 
of  9 [t)  and  9dit),  it  is  clear  that 


_ d * 

v3  =  Vd3  =  — -■  (16) 

zi 

The  expression  in  (5)-(8)  can  be  used  to  rewrite  p  it)  and 
pd  it)  in  terms  of  the  measurable  signals  ctfyf),  adift), 
Rft),  Rdit),  pi{t),  and  pdift)  as  follows 

V  it)  =  —  RTA~1pi  gd  it)  =  —RdA^pdi.  (17) 


9  —  Ul  c  9  d  —  tU  cd  (1^) 

where  <uc(f)  and  u>cdit)  were  introduced  in  Section  2. 
Based  on  the  fact  that  R{t),  Rdit),  and  R*  are  known, 
it  is  clear  from  (10)-(12)  that  0(f),  9dit),  and  iocdit)  are 
known  signals  that  can  be  used  in  the  subsequent  control 
development.  Note  that  vcdit)  is  not  a  measurable  signal. 
To  facilitate  the  subsequent  development,  9 it)  and  9d{i) 
are  assumed  to  be  confined  to  the  following  regions 

—  n  <  9  it)  <  7T  —  7T  <  9d  it)  <  7T  .  (13) 

Remark  2  Motivation  for  using  a  homography-based  vi¬ 
sual  servoing  approach  is  given  by  the  ability  to  con¬ 
struct  the  error  system  in  terms  of  reconstructed  Euclid¬ 
ean  information  and  image-space  information.  As  stated 
in  [17],  some  advantages  of  this  methodology  over  pre¬ 
vious  pure  image-based  approaches  are  that  an  accurate 
Euclidean  model  of  the  environment  (as  in  [20])  is  not 
required  and  potential  singidarities  in  the  image- Jacobian 
(which  are  endemic  to  traditional  pure  image-based  vi¬ 
sual  servo  controllers)  are  eliminated  (i.e.,  the  resulting 
image- Jacobian  in  this  paper  is  always  invertible). 

4  Control  Development 

The  control  objective  in  this  paper  is  to  ensure  that  the 
coordinate  frame  T  tracks  the  time-varying  trajectory  of 
Td  (i.e.,  the  Euclidean  coordinates  of  the  WMR  feature 
points  track  the  desired  time-varying  trajectory  in  the 
sense  that  ?h;(f)  — >  fhdi(t)).  To  quantify  the  control  ob¬ 
jective,  the  translation  and  rotation  tracking  error,  de¬ 
noted  by  eft)  =[ei  ft),  e2  ft),  e3ft)]T  £  M3,  is  defined  as 


Based  on  (14),  (17),  and  the  fact  that  9{t)  and  9dft)  are 
measurable,  it  is  clear  that  eft)  is  measurable.  By  exam¬ 
ining  (14)-(16),  it  can  be  shown  that  the  control  objective 
is  achieved  if  ||e(f)||  — >  0.  Specifically,  if  e3(f)  — >  0,  then 
it  is  clear  from  (10),  (11),  and  (14)  that  Rft)  — >  Rdft). 
If  ei(t)  — *•  0  and  e2  ft)  — >  0,  then  from  (14)  and  (16)  it  is 
clear  that  77  ft)  — >  pdft).  Given  that  Rft)  — >  Rdft)  and 
that  ?y  ft)  — >  qd  (t),  then  (15)  can  be  used  to  conclude  that 
fh\ft)  ->  mdi (t).  If  fhi  ft)  -»•  fhdi(t)  and  R(t)  — >  Rd(t), 
then  (1)  can  be  used  to  prove  that  fruft)  — >  ihdift). 

Remark  3  To  develop  a  tracking  controller,  it  is  typ¬ 
ical  for  the  desired  trajectory  to  be  used  as  a  feedfor¬ 
ward  component  in  the  control  design.  Hence,  for  a  kine¬ 
matic  controller  the  desired  trajectory  is  required  to  be 
at  least  first  order  differentiable  and  at  least  second  or¬ 
der  differentiable  for  a  dynamic  level  controller.  From 
the  Euclidean  homography  introduced  in  (6),  md(t)  can 
be  expressed  in  terms  of  the  a  priori  known  functions 
adift),  Hdft),  Rdft),  and  Xhdf )■  Since  these  signals  can 
be  obtained  from  the  prerecorded  sequence  of  images,  suf¬ 
ficiently  smooth  functions  can  be  generated  for  these  sig¬ 
nals  by  fitting  a  sufficiently  smooth  spline  function  to  the 
signals.  Hence,  in  practice,  the  a  priori  developed  smooth 
functions  adi(t),  Rd(t),  and  pd(t)  can  be  constructed  as 
bounded  functions  with  sufficiently  bounded  time  deriva¬ 
tives.  Given  9dft)  and  the  time  derivative  of  Rd(t),  9dft) 
can  be  determined.  In  the  subsequent  tracking  control  de¬ 
velopment,  fjdi  (t)  and  9dft)  will  be  used  as  feedforward 
control  terms. 

4Any  point  O,  can  be  utilized  in  the  subsequent  development; 
however,  to  reduce  the  notational  complexity,  we  have  elected  to 
select  the  image  point  0 1,  and  hence,  the  subscript  1  is  utilized  in 
lieu  of  i  in  the  subsequent  development. 
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4.1  Open-loop  Error  System 


4.2  Closed-Loop  Error  System 


To  facilitate  the  development  of  the  open-loop  tracking 
error  system,  we  take  the  time  derivative  of  (15)  as  follows 


V  =  T5T  + 


v- 


s  1 


u 


(18) 


where  the  following  relationships  were  utilized  [4] 

fhi  =  Rv  +  R[u]x  si  R  =  R  [w]  x  (19) 

and  v(t),  u(t)  €  M3  denote  the  respective  linear  and  an¬ 
gular  velocity  of  the  WMR  expressed  in  T  as 


=  [  vc  0  O' 


u> 


=  [  0  0  coc  ' : 


(20) 


In  (18),  the  notation  [-]x  denotes  the  3x3  skew-symmetric 
matrix  form  of  the  vector  argument. 

Without  loss  of  generality,  we  assume  that  the  feature 
point  O i  is  the  feature  point  assumed  to  be  located  at 
the  origin  of  the  coordinate  frame  attached  to  the  WMR, 
so  that  Si  =[0,  0,  0]T.  Based  on  (20)  and  the  assumption 
that  si  =[0,  0,  0]T,  we  can  rewrite  (18)  as  follows 


vc  , 

Vi  =  -y  +  V2  uc 

zi 

V2  =  -VlUc  ■ 


(21) 


Based  on  the  open-loop  error  systems  in  (23)  and  (25),  the 
linear  and  angular  velocity  control  inputs  for  the  WMR 
are  designed  as  follows 

vc  =  -kve i  +  e2oJc  -  z((r]2uc  -  r]dl)  (26) 

a)c  =  -k^es  +  9d-  i]dle2  (27) 

where  kv,  €  M  denote  positive,  constant  control  gains, 
and  9d{t )  and  r/di(t)  are  generated  as  described  in  Re¬ 
mark  3.  In  (26),  the  parameter  update  law  z\(t)  s  1  is 
generated  by  the  following  differential  equation 

z*i  =7iei(??2^c-57di)  (28) 

where  7i  €  M  is  a  positive,  constant  adaptation  gain. 
After  substituting  the  kinematic  control  signals  designed 
in  (26)  and  (27)  into  (23),  the  following  closed- loop  error 
systems  are  obtained 

z{ei  =  -kve i  +  e2cuc  +  zI(t]2ljc  -  f]dl) 

t2  =  -ei  uc  +  f]dle3  (29) 

e3  =  —  ku  e3  —  i]d  ie2 

where  (25)  was  utilized,  and  the  depth-related  parame¬ 
ter  estimation  error,  denoted  by  z\{t)  €  R,  is  defined  as 
follows 

z*i  4  z*  -  z*  .  (30) 


Since  the  desired  trajectory  is  assumed  to  be  generated  in 
accordance  with  the  WMR  motion  constraints,  a  similar 
expression  to  (21)  can  be  developed  as  follows 

Vdi  =  — r  +  Vd2  ^cd,  (22) 

zi 

Vd2  =  9dl^cd- 

After  taking  the  time  derivative  of  (14)  and  utilizing  (12) 
and  (21),  the  following  open-loop  error  system  can  be 
obtained 

z\e  l  =vc  +  zZ(ri2u>c-ridl) 

e2  =  +  rjdiOd  (23) 

£3  =  u)c  —  bd. 

To  facilitate  the  subsequent  development,  the  auxiliary 
variable  e2  ( t )  e  M  is  defined  as 

e2  =  e2  +  rjdie3-  (24) 

After  taking  the  time  derivative  of  (24)  and  utilizing  (23), 
the  following  expression  is  obtained 

e2  =  —e\ix)c  +  fidle3.  (25) 

Based  on  (24),  it  is  clear  that  if  e2(f),  e3{t)  — >  0,  then 
£2(1)  — >  0.  Based  on  this  observation  and  the  open- loop 
dynamics  given  in  (25),  the  following  control  development 
is  based  on  the  desire  to  show  that  e\  (t) ,  e2  ( t ) ,  e3  ( t )  are 
asymptotically  driven  to  zero. 


5  Stability  Analysis 

Theorem  1  The  control  input  designed  in  (26)  and  (27) 
along  with  the  adaptive  update  law  defined  in  (28)  ensure 
asymptotic  WMR  tracking  in  the  sense  that 

iim  || e  (t)||  =  0  (31) 

t — >00 

provided  the  time  derivative  of  the  desired  trajectory  sat¬ 
isfies  the  following  condition 

lim  rjdl  ±  0.  (32) 

t—>  OO 

Proof:  To  prove  Theorem  1,  the  non- negative  function 
V{t)  €  M  is  defined  as  follows 

V±\ztel  +  \?2  +  \el  +  ^?.  (33) 

The  following  simplified  expression  can  be  obtained  by 
taking  the  time  derivative  of  (33) ,  substituting  the  closed- 
loop  dynamics  from  (29)  into  the  resulting  expression, 
and  then  cancelling  common  terms 

V  =  -kve{  +  eizl(r]2wc  -  fdl)  -  -  —  z\z\.  (34) 

7i 

After  substituting  (28)  into  (34) ,  the  following  expression 
can  be  obtained 

V  =  -kve \  -  k^el  .  (35) 
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From  (33)  and  (35),  it  is  clear  that  ei(f),  ei  (f),  e3  (f), 
z{(t)  €  Coo  and  that  ei(f),  ez  ( f )  €  C2.  Since  zl(t)  £  Coo 
and  z{  is  a  constant,  the  expression  in  (30)  can  be  used 
to  determine  that  z(  ( f )  €  Coo  ■  From  the  assumption  that 
?7dl(f),  rld2tt)i  0d{t),  and  9d[t)  are  constructed  as 

bounded  functions,  and  the  fact  that  62  (t),  ez  (f)  €  Coo, 
the  expressions  in  (14),  (24),  and  (27)  can  be  used  to 
prove  that  ez  (f),  ^(t),  r]2(t),  9(t),  u>c(t)  €  Coo ■  Based  on 
the  previous  development,  the  expressions  in  (26),  (28), 
and  (29)  can  be  used  to  conclude  that  vc(t),  z((t),  ei(t), 
62(f),  63(f)  €  Coo-  Based  on  the  fact  that  ei(f),  63(f), 
ei(f),  63(f)  €  Coo  and  that  ei(f),  e3  (f)  €  C2,  Barbalat’s 
lemma  [18]  can  be  employed  to  prove  that 

lim  ei(f),  63(f)  =  0  .  (36) 

t — » OO 

From  (36)  and  the  fact  that  the  signal  f]dl  (f)  e2  (f)  is 
uniformly  continuous  (i.e. ,  f]dl  (f),  rjdl  (f),  62(f),  e2  (f)  € 
Coo),  Extended  Barbalat’s  Lemma  (see  the  Appendix) 
can  be  applied  to  the  last  equation  in  (29)  to  prove  that 

lim  63(f)  =  0  (37) 

t — ►oo 

and  that 

lim  f]dl  (f)  e2  (f)  =  0  .  (38) 

t — >00 

If  the  desired  trajectory  satisfies  (32),  then  (38)  can  be 
used  to  prove  that 

lim  £=2  (f)  =  0  .  (39) 

t — >oo 

Based  on  the  definition  of  62(f)  given  in  (24),  the  results 
in  (36)  and  (39)  can  be  used  to  conclude  that 


Based  on  (42),  the  linear  and  angular  velocity  kinematic 
control  inputs  for  the  WMR  are  redesigned  as  follows 

vc  =  ~kve  1  +  vcd  +  z{  ( r]d2u)cd  +  e2u)c  -  r)2uc)  (43) 

wc  =  -kuez  +  ojcd  -  e2vcd  -  z(r]d2e2u)cd  (44) 
along  with  the  following  adaptation  law 


Zi  =  — 7i  {ei(,Vd2UJcd  +  e2wc  -  tj2ujc)  -  e3e2rid2u)cd) . 

(45) 

By  using  the  following  nonnegative  function 

t  r  A  f  if;  2  1  *  — 2  1  2  1  ~*2  /  a 

Vi  —  2ZlCl  +  2^ 62  ^  V63  +  2r(~Zl  ’ 
the  result  in  Theorem  1  can  also  be  obtained  via  (43)-(45). 


6  Regulation  Extension 

Based  on  the  assumption  given  in  (32)  and  (41),  it  is 
clear  that  the  controller  developed  in  the  previous  section 
can  not  be  applied  to  solve  the  regulation  problem.  In 
this  section,  an  extension  is  presented  to  illustrate  how 
a  visual  servo  controller  can  be  developed  to  solve  the 
regulation  problem  for  the  fixed  camera  configuration.  To 
this  end,  the  following  kinematic  model  is  obtained  by 
examining  Figure  1 


cos  9  0 

sin  9  0 

0  1 


(47) 


lim  e2{t)  =  0  (40) 

t — >00 

provided  the  condition  in  (32)  is  satisfied.  □ 

Remark  4  The  condition  given  in  (32)  is  in  terms  of  the 
time  derivative  of  the  auxiliary  vector  r]dl  (f) .  For  WMR 
tracking  problems,  this  assumption  is  typically  expressed 
in  terms  of  the  desired  linear  and  angular  velocity  of  the 
WMR.  To  gain  insight  related  to  how  the  condition  in 
(32)  can  be  expressed  in  terms  of  the  desired  WMR  lin¬ 
ear  and  angular  velocities,  the  expression  in  (22)  can  be 
substituted  into  (32)  to  obtain  the  following  condition 

lim  ^  ^  -Vd2^cd-  (41) 

t—> 00  z( 

The  condition  in  (41)  is  comparable  to  typical  WMR 
tracking  results  that  restrict  the  desired  linear  and  an- 
gidar  velocity.  For  an  in-depth  discussion  of  this  type  of 
restriction  including  related  previous  results  see  [8]. 

Remark  5  For  some  cases,  the  signals  vcd{t)  and  LOcd(t) 
may  be  a  priori  known.  For  this  case  (12)  and  (22)  can 
be  substituted  into  (23)  as  follows 

z\e  1  =vc-  vcd  +  z*(rj2u}c  -  iid2tvcd) 

e2  =  ~Vi  uc  +  Vdi^cd  (42) 

^3  —  ^cd’ 


where  xc(f),  yc(f),  and  8(t)  denote  the  time  derivative  of 
xc(f),  yc(t),  and  9(t)  €  R,  respectively,  where  xc(t)  and 
yc(t)  denote  the  planar  position  of  T  expressed  in  T* , 
9{t)  was  introduced  in  (10),  and  vc(t)  and  uc{t)  denote 
the  linear  and  angular  velocity  of  IF.  In  addition  to  the 
kinematic  model  in  (47),  the  geometric  relationships  be¬ 
tween  the  coordinate  frames  (see  Figure  2),  can  be  used 
to  develop  the  following  expressions5 

m\  =  d*x*f  +  R*  si  fh\  =  d*x-h  +  Rsi  (48) 

[  xc  yc  0  ] T  =  d*R*T  (xh  -  x*h) .  (49) 

After  utilizing  (5),  (48),  (49),  and  the  assumption  that 
si  =[0,  0,  0]T,  the  following  expression  can  be  obtained 

-4  [  xc  Vc  0  ]T  =  R*t  —mi-m*  (50) 

z 1  L  J 

where  ai(f)  was  defined  in  (6).  After  utilizing  (8),  the 
expression  in  (50)  can  be  rewritten  as  follows 

4  [  xc  Vc  0  ]T=f?*TA-1  —Pi~p\  .  (51) 

L^i 

5  See  [4]  for  details  regarding  the  development  of  the  following 
relationships. 
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To  facilitate  the  subsequent  control  objective,  a  global 
invertible  transformation  is  defined  as  follows  [8] 


ei 

A 

e2 

— 

.  e3  . 

cos# 

—  sin# 
0 


sin# 

cos# 

0 


0 

0 

1 


Xr 

zt 

Vo 

Z1 

# 


(52) 


where  e(t)  =  [  ei (t)  e2 (t)  (t)  ]T  £  K3  denotes  the 

regulation  error  signal.  From  (10),  (51),  and  (52),  it  is 
clear  that  e(f)  is  a  measurable  signal,  and  that  if  ||e(t)||  — > 
0,  then  xc(t )  — >  0,  yc(t )  — >•  0,  and  #(t)  —>■  0.  After  taking 
the  time  derivative  of  (52),  the  following  open-loop  error 
system  can  be  obtained 


For  the  simulation,  desired  pixel  information  from  a  prere¬ 
corded  sequence  of  images  (and  the  corresponding  spline 
function)  were  not  utilized  to  generate  the  feedforward 
signals  in  (26)  -  (28);  rather,  (12)  and  (22)  were  utilized 
to  calculate  ??d(t),  Vdl(t),  #d(i),  and  6d{t).  Specifically,  by 
numerically  integrating  (22)  with  the  values  given  in  (59), 
the  desired  signals,  denoted  by  rjdl(t)  and  r]d2(t ),  can  be 
determined.  By  numerically  integrating  oocd(t),  the  value 
for  6d(t)  can  also  be  determined.  For  the  simulation,  the 
reference  and  initial  pixels  were  selected  as  follows 

pi  =  [146  145  1]  (60) 

Pi(0)  =  [67  181  1], 


<2l 

%  +  <nce2 

zi 

e2 

= 

-cncei 

.  . 

UJC 

where  (47)  was  utilized.  Based  on  (53),  the  linear  and 
angular  velocity  inputs  are  designed  as  follows 

vc  =  —k\e\  u>c  =  -k^e-i  +  e2  sint  (54) 

to  yield  the  following  closed-loop  error  system 

z*e  i  =  —  fciei  +  z\uce2 

e2  =  -ioce  i  (55) 

<23  =  -fc2e 3  +  e\  sinf. 


Based  on  the  initial  condition  and  reference  coordinates 
in  (60),  the  initial  translation  and  rotation  errors  were 
determined  as  follows 

ei  (0)  =  0.042  e2  (0)  =  -0.194  e3  (0)  =  1.40  (rad) 
where 

?7(0)  =  [0.140  -  0.038  -0.983] 

i!d{  0)  =  [0.098  0.156  -  0.983]. 

The  control  gains  kv  and  ku  were  adjusted  to  the  fol¬ 
lowing  values  to  yield  the  best  performance 

kv  =  10  ku  =  5. 


Theorem  2  The  control  input  designed  in  (54)  ensures 
asymptotic  WMR  regulation  in  the  sense  that 

lim  ||e  (t)\\  =  0.  (56) 

t — »00 

Proof:  Let  V(t)  £  R.  denote  the  following  non-negative 
function 

y~\zl{e\+el).  (57) 

After  taking  the  time  derivative  of  (57)  and  utilizing  (55), 
the  following  simplified  expression  is  obtained 

V  =  -kxe\.  (58) 

By  utilizing  Barbalat’s  Lemma  and  Extended  Barbalat’s 
Lemma  in  a  similar  manner  as  in  the  proof  for  Theorem 
1,  the  control  inputs  can  be  proven  to  be  bounded,  and 
the  result  in  (56)  can  be  obtained  [8].  □ 

7  Simulation  Results 

A  numerical  simulation  performed  to  illustrate  the  per¬ 
formance  of  the  controller  given  in  (26)-(28).  The  desired 
trajectory  was  generated  by  numerically  integrating  (22), 
where  the  unknown  constant  scaling  term  d*  and  the  de¬ 
sired  linear  and  angular  velocity  were  selected  as  follows 

d*  =  7.86  [m]  vcd(t)  =  0.2sin(t)  [m/sec]  tocd(t)  =  0 

(59) 


After  the  best  performance  that  could  be  achieved  by  ad¬ 
justing  the  feedback  gains  was  obtained,  the  adaptation 
gain  was  adjusted  to  the  following  value  to  yield  im¬ 
proved  performance 

7!  =  745. 

The  resulting  translational  and  rotational  errors  for  the 
WMR  are  depicted  in  Figure  3,  and  the  parameter  esti¬ 
mate  signal  is  depicted  in  Figure  4.  The  control  input 
velocities  vc(t)  and  uc(t)  defined  in  (26)  and  (27)  are  de¬ 
picted  in  Figure  5.  Note  that  the  angular  velocity  input 
was  artificially  saturated  between  ±80.25[deg-s-1]. 

8  Conclusions 

In  this  paper,  the  position/orientation  of  a  WMR  is 
forced  to  track  a  desired  time-varying  trajectory  defined 
by  a  prerecorded  sequence  of  images.  To  achieve  the  re¬ 
sult,  multiple  views  of  four  target  points  were  used  to 
develop  Euclidean  homograpliies.  By  decomposing  the 
Euclidean  homographies  into  separate  translation  and  ro¬ 
tation  components,  reconstructed  Euclidean  information 
was  obtained  for  the  control  development.  A  Lyapunov- 
based  stability  argument  was  used  to  design  an  adaptive 
update  law  to  compensate  for  an  unknown  depth  para¬ 
meter.  The  impact  that  the  development  in  this  paper 
li$jak(fe)  iaafclyhfea) .  new  analytical  approach  has  been  de¬ 
veloped  using  homography-based  concepts  to  enable  the 
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position/orientation  of  a  WMR  subject  to  nonholonomic 
constraints  to  track  a  desired  trajectory  generated  from 
a  sequence  of  images,  despite  the  lack  of  depth  measure¬ 
ments.  In  contrast  to  the  work  in  [7],  the  camera  is  not 
required  to  be  mounted  so  that  the  optical  axis  is  per¬ 
pendicular  to  the  WMR  plane  of  motion.  An  extension 
is  provided  to  illustrate  the  development  of  a  visual  servo 
regulation  controller.  Simulation  results  are  provided  to 
demonstrate  the  performance  of  the  tracking  control  de¬ 
sign. 
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Appendix 

The  Extended  Barbalat’s  Lemma  was  utilized  in  the 
stability  analysis  for  Theorem  1.  This  lemma  stated  as 
follows,  and  a  proof  for  the  Lemma  can  be  found  in  [8]. 

Lemma  1  If  a  differentiable  function  f(t)  €  M  has  a  fi¬ 
nite  limit  as  t  — >  oo,  and  its  time  derivative  can  be  written 
as  follows 

f(t)  =  gfft)  +  g2(t),  (61) 

where  gi  (t)  is  a  uniformly  continuous  function  and 

lim  g2(t)  =  0,  (62) 

t — »oo 

then 

lim  f(t)  =  0  and  lim  gfft)  =  0.  (63) 

t — >oo  t — »oo 
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Figure  1:  Mobile  robot  coordinate  systems. 


Fixed  camera 


Figure  2:  WMR  coordinate  frame  relationships. 
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